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Abstract. We analyse the storage and retrieval capacity in a recurrent neural net- 
work of spiking integrate and fire neurons. In the model we distinguish between a 
learning mode, during which the synaptic connections change according to a Spike- 
Timing Dependent Plasticity (STDP) rule, and a recall mode, in which connections 
strengths are no more plastic. Our findings show the ability of the network to store 
and recall periodic phase coded patterns a small number of neurons has been stim- 
ulated. The self sustained dynamics selectively gives an oscillating spiking activ- 
ity that matches one of the stored patterns, depending on the initialization of the 
network. 
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Introduction 

In many areas of the brain, with different brain functionality, it has been recently hy- 
pothesized that spike phase (i.e. the relative phases of the spikes of neurons participating 
to a collective oscillation, or the phases of spikes relatively to the ongoing oscillation) 
play a crucial role in coding information, together with the conventional spike rate code. 
Experimental evidence of the importance of spike phases in neural coding starts with the 
first experiments on theta phase precession in rat's place cells [12], showing that both 
spike rate and spike phase are correlated with rat's position. In addition to this, several 
experiments on short-term memory of multiple objects in prefrontal cortices of monkeys 
O supported the hypothesis that collective oscillations may underlie a phase-dependent 
neural coding and that the distinct phase alignment of information relative to population 
oscillations may play a role for disambiguating individual short-term memory items, hy- 
pothesis are also pointed out in the experiments on spike-phase coding of natural stimuli 
in auditory and visual primary cortex M4I5I . 

In particular the path-integration system and the hippocampal and entorhinal cortex cir- 
cuit, that forms a spatial map of the environment, has been deeply investigated 1112161 . 
showing that the place cells and grid cells form a map in which precise phase relation- 
ship among units play a critical role. The oscillators interference models [7 8| of path- 
integration are based on the integration of animal velocity by phase of oscillator cells 
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(such as a theta cell whose frequency is modulated by the animals' velocity), and the 
read-out of this phase by interference between different oscillators. In the paper of Blair 
et al. Q, for example, the rate-coded position information of the grid cells comes from 
a set of theta oscillatory cells whose frequency is precisely modulated by the rat's move- 
ments' velocity. Different sets of such theta cells are needed, with cells in different sets 
have different frequency, and cells in each set have a different phase relationships each 
other. Moreover, since phase angles between different theta oscillators encode the rat's 
position, the oscillators must maintain stable phase relationships with one other over be- 
haviorally relevant time scales (many seconds, or dozens of theta cycle periods). Hence, 
oscillatory interference models impose strict constraints upon the dynamical properties 
of theta oscillators. It is not presently known whether these constraints are satisfied by 
theta-generating circuits in the rat brain, and if so, how. 

In this paper we present a possibility to build a circuit in which stable phase relation- 
ships between spikes of different neurons are maintained in a robust way with respect 
to noise. This feature is due to the robustness of the dynamical attractors with respect 
to noise, which are also stable across the changes of frequency. Indeed the collective 
frequency of the circuit depends on the firing threshold O and the phase relationships 
among units in the circuit is maintained when output global frequency of the circuit is 
changed, indeed it is the phase relationship that is a dynamical attractor of the circuit and 
not the absolute spike timing difference among units. The mechanism of storing infor- 
mation in the specific spike pattern of activity and recall info by recalling the specific 
spike alignment (or spike phase in case of periodic spatiotemporal pattern) may be a 
useful mechanism as substrate for memory. The importance of precise timing relation- 
ships among neurons, which may carry information to be stored, is supported also by the 
evidence that precise timing of few milliseconds is able to change the sign of synaptic 
plasticity. The dependence of synaptic modification on the precise timing and order of 
pre- and postsynaptic spiking has been demonstrated in a variety of neural circuits of 
different species. Many experiments show that a synapse can be potentiated or depressed 
depending on the relative timing of the pre- and post-synaptic spikes. This timing depen- 
dence of magnitude and sign of plasticity, observed in several types of cortical [10 1 11121 
and hippocampal B12I13I15II neurons, is usually termed Spike Timing Dependent Plas- 
ticity or STDP. Here, we face the role of a learning rule based on STDP in storing multi- 
ple phase-coded memories as attractor states of the neural dynamics. The spatio-temporal 
patterns are periodic sequences of spikes, whose features are encoded in the phase shifts 
between firing neurons. 

We use an Integrate-and-Fire (IF) neuronal model, namely in a Spike-Response Model 
(SRM) formulation, which is very popular for theoretical studies on populations of neu- 
rons, especially for large-scale simulations. This simple choice is suitable to study the 
storage and retrieve capability of the network, instead of focusing on the complexity of 
the neuronal structure. Once performed the learning stage, we examine the network ca- 
pability to replay(retrieve) a stored pattern. Partial presentation of a pattern, i.e. short 
externally induced spike sequences, with phases similar to the ones of the stored phase 
pattern, induces the network to retrieve selectively the stored item, as far as the number 
of stored items is not larger then the network storage capacity. If the network retrieves 
one of the stored items, the neural population spontaneously fires with the specific phase 
alignments of that pattern, until external input does not change the state of the network. 



1. Learning with Spike-Timing Dependent Plasticity 



In the experiment of Markram IflOl it was reported that if the pre-synaptic spike repeat- 
edly precedes a post- synaptic action potential within a short time window (10 -20 ms), 
the synapse is potentiated (Long Term Potentiation, LTP). If the opposite occurs, the 
synapse undergoes depression (Long Term Depression, LTD). Both effects are combined 
in a synapse equipped with STDP fl 1 61 151131 141 1 01 1 J1 . where the degree of change in 
synaptic strength depends on the delay between pre and post-synaptic spikes, via a learn- 
ing window that is temporally asymmetric (see Fig. 1). In our model we consider a re- 
current neural network with N(N — 1) possible connections Jy, where N is the number 
of neural units. The connections Jy , during the learning mode, are subject to plasticity 
and change their efficacy according to a learning rule inspired to the STDP. After the 
learning stage, the collective dynamics is studied. 

According to the learning model already introduced in 1191181171 . the change in the con- 
nection Jij that occurs in the time interval [— T, 0] due to periodic spike trains can be 
formulated as follows: 

o o 

SJ i:j oc J dt J dt' 'yi(t)A(t - t')yj(t') (1) 

—T -T 

where yj (t) is the activity of the pre-synaptic neuron at time t, and j/j (t) the activity of 
the post-synaptic one. It means that the probability that unit i has a spike in the interval 
(t, t + At) is proportional to yi(t)At in the limit At — > 0. The learning window A(r = 
t — t') is the measure of the strength of synaptic change when a time delay r occurs 
between pre and post-synaptic train. To model the experimental results of STDP, the 
learning window A(t) should be an asymmetric function of r, mainly positive (LTP) for 
r > and mainly negative (LTD) for r < 0. 

While Eqn. (1) holds for activity pattern y(t) which represents instantaneous firing rate 
and it has been studied in a analog rate model 11 191 1 81 1 71 and in a spin network model 
11261 . here we want to study the case of spiking neurons. Therefore, the patterns to be 
stored are defined as precise periodic sequence of spikes. Namely, the activity of the 
neuron j is a spike train at times tj, 

n 

where tj + nT^ is the set of spike times of unit j in the pattern /j, with period T M . 
Therefore the change in the connection during the learning of pre-synaptic and post- 
synaptic spike trains of the periodic pattern \i, is given, following Eqn. 1, by 

n 

The window A(t) that we use, shown in Fig. 1, is given by 
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Figure 1. a) Plot of the learning window A(t) used in 
the learning rule (see Eqs. (1), (2), (3)) to model STDP. 
Parameters of the function (see Eqn. (4)) fit the experi- 
mental data of 1 13 1. 



with the same parameters used in ||20l to fit the experimental data of HI 31 , a p = 
7 [1/T p + v/TdV 1 , a D = 7 [tj/T p + 1/T D }~\ with T p = 10.2 ms, T D = 28.6 ms, 
r\ = 4, 7 = 42. This function satisfies the balance condition A(t)cIt = 0. 
Writing Eqn. (l)-(2), implicitly we have assumed that, with periodic spike trains used to 
induce plasticity, the effects of all separate spike pairs sum linearly with the STDP kernel 
shown in Fig. 1. Note that this rule is valid only when, as here, simple periodic spike 
trains are used to induce plasticity, and in a proper range of frequency. Timing-dependent 
learning curves as shown in Fig. 1 are indeed typically measured by giving a sequence 
of 100 pairs of spikes repeatedly, with fixed frequency in a proper range. In fact, pairing 
single presynaptic and postsynaptic spikes, or pairing at very low frequency (1Hz) led to 
an LTD-only STDP kernel ll27l . Similarly, pairing at high enough frequencies [12| the 
timing-dependent rule becomes LTP-only, i.e., both positive and negative timings pro- 
duce LTP Moreover the number of pairing also can change the bidirectional kernel shape 
into a LTP-only shape. In particular, for arbitrary non-periodic spike trains major nonlin- 
earities arise from the history of spike activity, also on timescales longer than the width 
of the STDP curve (see [9| and reference therein). The simple model that we use here, 
Eqn. 3, is enough to describe the plasticity that occurs when long periodic spike trains 
with frequency in a proper range is used. At very low, as well as very high frequency, 
and with few spike pairs, the timing dependence of plasticity is not well described by the 
bidirectional kernel shown in Fig. 1, and a more detailed model is needed to account for 
integration of spike pairs when not-periodic arbitrary trains are used [9 |. 
The spike spatiotemporal patterns that we study in this paper are periodic spatiotem- 




Figure 2. Visual representation of the connection matrix Jy resulting from network with N=30()0 units and 
P stored patterns at w M = 20Hz. Left P=l, middle P=2, right P=20. 



poral patterns of spikes, with phases of spike <f>^ randomly chosen from a uniform 
distribution in [0,2-71"). Namely, the set of timing of spikes of unit j can be noted as 
tj + nT^ = ((f) ^ + 27m) o; M /27r is the oscillation frequency of the neurons. Thus, 
each pattern /i is defined by its frequency lu^/2tt, and by the specific phases of spike 4>j 
of the neurons j — 1, .., N, 

Therefore, the change in the connection Jy provided by the learning of pattern /i is given 
by 

4 = E A W % + nT ") = E A (^/^ - ti/ u * + 2 ™mj- (5) 
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In each pattern, information is coded in the precise time delay between unit i and unit 
j spikes, that corresponds to a precise phase relationship among the unit i and j, there- 
fore this kind of spatiotemporal patterns is often called phase coded pattern. When we 
store multiple phase coded patterns defined in (2), with /x = 1, 2, . . . , P, the learned 
connections are the sum of the contributions from individual patterns, namely 

p 

The connection matrix Jij coming out from Eqn. (3) and (5) at cj m = 20Hz and 0f 
randomly chosen in [0, 27r], is shown in Fig. 2 for P=l, P=2 and P=20. The units i, j on 
the axes are sorted according to the value of <j)\ of first pattern /j, = 1. With P=l it's 
clearly visible the structure of the connectivity matrix, however note that even at P=20, 
when the correlation structure of the connectivity matrix with the stored patterns is not 
visible, the network is still able to selectively retrieve each of the P stored patterns, in a 
range of neuronal threshold values such that storage capacity is equal or higher then 20. 



2. Model Dynamics 

We distinguish a learning mode in which plasticity rule (3), (4) and (5) is used to store 
P phase-coded pattern into the network connectivity, from a dynamic mode (or retrieval 
mode) in which connections Jy are fixed to the value found after learning (Eqn. (5)) and 
the dynamics of the neurons is studied. Therefore we simulate a Leaky Integrate and Fire 
network, with fixed connections. The Leaky Integrate and Fire model of single neuron 
is given by a simple Spike-Response-Model formulation (SRM) introduced by Gernster 
in 112 11221 . While integrate-and-fire models are usually defined in terms of differential 
equations, the SRM expresses the membrane potential at time t as an integral over the 
past. When membrane potential reach a threshold 9 a spike is scheduled. This allows 
us to use a event-driven programming and makes the numerical simulations faster with 
respect to a differential equation formulation. In its simplified version [21], the SRMo 
model, where neuronal refractoriness is not taken into account, the internal state of a 
spiking neuron depends on the last output spike and on the total postsynaptic potential. 
Supposing the membrane resting potential is set to zero after a spike, neglecting the shape 
of the spiking pulse, the postsynaptic membrane potential is given by: 



Figure 3. Dynamics of a network with N = 3000 neurons and connections given by Eqn. (6) with P = 5 
and ui^ = 20 Hz. A subset of 32 neurons is chosen and sorted by increasing values of phase <f>\ of the stored 
pattern fj, = 1. Different colors refer to phase values belonging to different phase intervals of pattern ft = 1: 
(0 — tt/2) red, (jt/2 — n) green, (n — 3/2ir) blue,(3/2-7r — 2tt) black . The stored pattern is shown in a), 
plotting the times (<f>j + 27rn)/aJi. Hence, the generated dynamics when a short train of M = 300 spikes 
is induced on the network, corresponding to the pattern fi = 1 in b) and /i = 2 in c). Figure b) shows that 
when the network dynamic is stimulated by a partial cue of pattern fi = 1, the neurons oscillate with phase 
alignments resembling pattern fi = 1, but at different frequency. Otherwise, in c), when the partial cue is taken 
from pattern fj, = 2, the neurons phase relationships, even if periodic, are uncorrelated with pattern = 1, 
and recall the phase of pattern fj, = 2. 



where the sum over tj runs over all presynaptic firing times. The function e describe the 
response kernel to incoming spikes on neuron i. Namely, each presynaptic spike j, with 
arrival time tj, is supposed to add to the membrane potential a postsynaptic potential of 
the form Jije(t — tj), where 



e(t-tj) = K 



exp I — exp 1 



H(t-tj) (8) 



where r m is the membrane time constant (here 10 ms), r s is the synapse time constant 
(here 5 ms), H is the Heaviside step function, and K is a multiplicative constant chosen so 
that the maximum value of the kernel is 1 . The sign of the synaptic connection Jy set the 
sign of the postsynaptic potential's change. When the postsynaptic potential of neuron i 
reaches the threshold 0, a postsynaptic spike is scheduled, and postsynaptic potential is 
reset to the resting value zero. Note that a change of 9 in our model may correspond to a 
change in the value of spiking threshold of the units, or to a global change in the scaling 
factor of synaptic connections since what matters is the ratio Jij/Q- Anyway a lower 
value of correspond to a higher excitability of the network. We simulate this simple 
model with Jy taken from the learning rule given by Eqn. (5)-(6), with P patterns in a 
network of N units. 

In the following, the network capacity is analyzed considering the maximum number of 
patterns that the network is able to perfectly recall. In particular we investigate the role 
of two parameters of the model: the frequency of the stored patterns cj m , and the firing 
threshold 6 which change the excitability of the network. 



3. Storage capacity analysis 



We did numerical simulations of the SRM network described in Eqn. (8)-(9) with 
N = 3000 neurons, and connections J,j given by (5) with different number of patterns 
P. After the learning process, to check if it's possible to recall one of the encoded pat- 
terns, we give an initial signal equal to M <C N spikes, taken from the stored pattern [i, 
and we check that after this short signal the spontaneous dynamics of the network gives 
sustained activity with spikes aligned to the phases tpf of pattern /i. During the retrieval 
mode, connections strength is no more plastic as it happens for the learning mode. This 
distinction in two stages (learning and retrieval), even though is not well assessed in real 
neural dynamics, is useful to simplify the analysis and also finds some neurophysiologi- 
cal motivations II23I241 . An example of successful selective retrieval process is shown in 
Fig. 3 where, depending on the partial cue presented to the network, the phase of firing 
neurons resemble one or another of the stored patterns. The network dynamic is initially 
stimulated by an initial short train of M — 300 spikes (10% of the network) chosen at 
times from pattern /j, = 1,2 and we check if this initial train triggers the sustained 
replay of pattern fj, = 1, 2 at large times. We introduce a quantitative similarity measure 
to estimate the overlap between the network activity during the spontaneous dynamics 
and the stored phase-coded pattern, defined as 
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where t* is the spike timing of neuron j during the spontaneous dynamics, and T* is 
an estimation of the period of the collective spontaneous dynamics. The overlap in Eqn. 
(9) is equal to 1 when the phase-coded pattern is retrieved perfectly (even thou with a 
different time scale), while is ~ 1/yN when phases of spikes are uncorrected to the 
stored phases. The Figure 4 shows results of numerical simulations averaged over 50 
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Figure 4. Capacity estimation of a network made up of 3000 neurons. In order to verify that recall of a stored 
pattern is correct, we compared the phases of pattern fi = 1 with spontaneous network dynamic stimulated by 
300 spikes chosen at times ti (i = 1 • ■ • 300). The firing neuronal firing threshold, © n = 170. For each boxes 
in the figure the y-axis represent the number of stored patterns and x-axis is the frequency of the stored patterns 
ui^/2-it. In a) the overlap measure defined in Eqn. (9) is shown in a black and white color legend: the brighter 
is the color the higher is the overlap |m M (4)|. b) Probability of sustained activity with the same color legend 
used for the overlap. In c) the effective capacity of the network is shown, i.e. a pattern is considered perfectly 
retrieved once the product of the overlap with the probability of sustained activity is higher than 0.5. 



runs, namely for different implementations of the network and patterns to be stored. The 
overlap \m^(t) | is reported in Fig. 4a in a black and white colored legend, along with the 
probability of self-sustained activity, Fig. 4b as a function of uj^ at fixed firing threshold 
(6 = 170). This gives an indication of whether or not the initial stimulating spikes are 




Figure 5. a) Summary of the network capacity as a function of the frequency and firing threshold. The color 
legend shows the number of correctly stored pattern, b) Probability of self-sustained activity for a network with 
P=3 stored patterns in the plane (cj, 0). The color legend shows the region of the plane where a pattern could 
be stored. 



sufficient to generate a persistent spontaneous oscillatory activity regardless of the phases 
alignment between neurons. In our analysis we did not considered the non-persistent ac- 
tivity, that is the spontaneous dynamic occurring in a short transient time, right after the 
initial stimulating spikes. This means that black colored areas in Fig. 4 are not neces- 
sarily associated with an absence of spontaneous activity, but only to an absence of long 
term activity. Hence, we consider a successful pattern replay when the overlap, weighted 
with the probability of long term sustained activity, is larger than 0.5. This is reported in 
Fig. 4c, where we observe a large interval of frequency with a good storage capacity. 
We also investigate the role of the firing threshold 0. Note that changing in our model 
may correspond to a change excitability, i.e a change of firing threshold or in global 
change in the synaptic connections . Indeed, the working range of the network de- 
pends on both the frequency of the stored pattern, as well as on the threshold 0. The 
capacity of the network is summarized in Fig. 5, where we report, in the plane frequency- 
threshold (w, 0), the number of perfectly replayed pattern (Fig. 5a) and the probability 
of sustained activity (Fig. 5b). 

Another important result is observed looking at neurons firing activity. In Fig. 6 we see 
that by lowering the threshold below an optimal value, a burst of activity takes place 
within each cycle, with phases aligned with the pattern. This open the possibility to have 
a coding scheme in which the phases encode pattern's information, and rate in each cycle 
represents the strength and saliency of the retrieval or it may encode another variable. 
The recall of the same phase-coded pattern with different number of spikes per cycle 
accords well with recent observation of Huxter et al. Il25l in hippocampal place cells, 
showing occurrence of the same phases with different rates. They show that the phase 
of firing and firing rate are dissociable and can represent two independent variables, e.g. 
the animals location within the place field and its speed of movement through the field. 
The number of spikes per cycle as a function of the threshold is reported in Fig 7 a, 
where a dependence on the frequency of the replayed pattern is also observed in the plane 
frequency-threshold. 

Lastly, in Fig. 7b, the dependence of the output frequency of collective oscillations is 
studied as a function of 0. Notably, the stored phase-coded patterns are replayed in a 
compressed time scale for uj^/2tt < 30 Hz. 
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Figure 6. Recall of the pattern fi = 1 for networks of 3000 neurons having different values of parameter 0, 
namely = 100 in a), = 60 in b) and = 20 in c). Depending on the value of 0, the phase-coded pattern 
is replayed with a different number of spikes per cycle. 




Figure 7. (a) The number of spikes per cycle as a function of the firing threshold for a network with one 
encoded pattern, at different frequencies ui^/2-it. (b) The network oscillating frequencies as function of the 
firing threshold. A stored pattern is replayed at frequencies which slowly decays with increasing for most of 
the pattern frequencies w M /27r. 



4. Conclusions 

We studied the storage and replay properties of a network of spiking integrate and fire 
neurons, whose learning mechanism is based on the Spike-Timing Dependent Plasticity. 
The encoded patterns are periodic spike sequences, whose features are encoded in the 
relative phase shifts between neurons. The proposed associative memory approach, that 
replay the stored sequence, can be a method for recognize an item, by activating the same 
memorized pattern in response of a similar input, or could be a method to transfer the 
memorized item to another area of the brain (such as for memory consolidation during 
sleep). We systematically quantify and compare the retrieval capacity of the network by 
changing two parameters of the model: the frequency of the input (encoding) patterns, 
uj/2ir, and the neuronal firing threshold, 0. The response of the network changes by 
changing those parameters which, however, are not the only ones governing the spiking 
activity of neurons. Future works will consider a further analysis of the model parameters 
and wheter to tune them to modify the network capability in a controlled manner. 
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